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The virtual reality (VR) provides us a three-dimensional, immersive, and fully interactive visualization envi- 
ronment. To make the best use of the VR's potential in scientific visualization, a VR visualization software named 
VFIVE has been developed for the CAVE-type VR system. VFIVE enables simulation researchers to analyze three- 
dimensional scalar and vector fields by various visualization methods including real time volume rendering in the 
cave's room sized booth. Some basic visualization tools of VTK have been integrated to VFIVE, too. 



1. Introduction 

The possibility offered by Virtual Reality (VR) to the sim- 
ulation science is an innovation of the scientific visualiza- 
tion. VR visualization is not a theory, but rather akeady a 
practical technology that can be used in our daily research 
routine. 

Simulation science is supported by two key technologies; 
computation and visualization. The technology of computa- 
tion, or computer, is still keeping an exponential growth. In 
this sense, we are living in a golden age of simulation sci- 
ence. However, a high-rise building should be supported by 
balanced pillars. Unfortunately, the development of visual- 
ization technology does not catch up with its counterpart. It 
would be absurd if we had to spend a month to understand 
the simulation data obtained by one-hour-job on ultra super 
computer. 

In the Stone Age of computer simulation when 1- 
dimensional (1-D) phenomena are mostly simulated, simple 
graph plot on a piece of paper would have been sufficient to 
understand or to visualize the data. When 2-D simulation 
were common, iso-line plots and contour color plots on pa- 
pers or computer monitor screens would have been enough. 

In the beginning of 1990's, 3-D simulations with the grid 
size of 0(100"^) was not rare. We familiarized ourselves 
with newly introduced visualization technology at that time; 
it was so called "visualization software" (such as AVS) on 
graphic workstations (GWS). We could instantly see an iso- 
surface of 100"^ data points through the GWS's monitor, we 
could zoom, rotate, color the objects, and change the isosur- 
face levels, via graphical user interface using the mouse. By 
the interactive manipulation through the GWS's monitor, we 
could grasp 3-D structure of the numerical data. This visu- 
alization technology based on GWS was certainly powerful 
enough at that time. 

Now, the complexity of target phenomena of the present 
high-end super computer, such as the Earth Simulator', are 
extremely high; the typical grid size is 0(1000'^). Even if 
we could make, render, and rotate an isosurface object on 
the O(IOOO^) grid points in real time on the GWS or PC 
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with the advanced graphics card, the complicated shape itself 
of the isosurface prevents us from the intuitive and instant 
understanding of the 3-D structure of the scalar field. 

Another limitation of the GWS-based visualization tech- 
nology is the ability (or inability) of visualization of vector 
fields. In our research fields, fluid flows, electric fields, and 
magnetic fields are all 3-D vector fields. We need to grasp 
spatial structure of the 3-D vector fields defined on O(IOOO^) 
grid points in order to understand what was simulated in the 
simulation. This is really a challenging task and obviously 
beyond the outdated, GWS-based visualization technology. 
Simulation scientists really need an innovation in the visu- 
alization technology that suits the modern high-end super 
computer. And we believe that the virtual reality (VR) is 
the answer. 

Everyone who experiences a modern VR system for the 
first time would be surprised by its high quality of mimicked 
reality. They feel like they are deeply absorbed, or really 
standing, in the mimicked world. In order to produce such 
a deep absorption into the VR world, there are three impor- 
tant visual factors^; (1) stereo view, (2) immersive view, and 
(3) interactive view. Among various kinds of available VR 
hardwares, we believe that the CAVE [Cruz-Neira: 1993] sys- 
tem suits best to our purpose of the visualization of large 
scale 3-D scalar and vector fields. The CAVE is developed at 
Electric Visualization Laboratory (EVL), University of Illi- 
nois^. We installed our CAVE system at Earth Simulator 
Center, Japan Agency for Marine-Earth Science and Tech- 
nology (JAMSTEC) in 2002, and named it BRAVE. 

2. HardwareofVR Visualization: BRAVE 

BRAVE is a cubic room with the size of 3m x 3m x 3m. 
It has four stereo screens (three walls and a floor). See 
Fig. n The viewer stand in the BRAVE room on the floor 
screen, wearing stereo glasses, with a portable controller 
called wand. Stereo images are projected on the three walls 
and the floor by four projectors. Since the viewer inside the 
BRAVE room is surrounded by stereo images on the three 

"Sonifications [Tamura:2001] and haptics ai'e other important VR tech- 
nology that could be appUed in scientific visuaUzation in future. 
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Software of VR Visualization: VFIVE 




Fig. 2. Interactive menu of our original VR visualization software VFIVE. 



Fig. 1 . The CAVE system in the Earth Simulator Center, called BRAVE. 



walls and the floor, he or she can look around like a owl in 
the BRAVE room, keeping the wide range of stereo view 
angle. This strongly enhances the immersive sense of the 
viewer. The refresh rate of the image is 96 Hz: The right- 
eye image and the left-eye image are projected alternately 
with 48 Hz each. The image refresh is synchronized with the 
stereo glasses by the infrared. The images on the boundaries 
between the walls and the floor are smoothly connected. The 
viewer can easily forget the existence of the boundaries. Ac- 
tually, some people had banged on the walls of the BRAVE. 

BRAVE has a magnetic tracking system to detect the po- 
sition and direction of the viewer's eyes (by a sensor on the 
stereo glasses), and the viewer's hand (by another sensor 
on the wand). All the projected images are automatically 
adjusted in real time following the viewer's head motion. 
Therefore, everything looks natural from the viewer who can 
tilt, walk, sit, or even jump in the BRAVE room to observe 
3-D objects in the virtual world. 

The wand, which has 3 buttons and 1 joystick, is used 
to the interface with the virtual world (or simulation data). 
For example, when viewer presses a wand button, a virtual 
menu panel appears in front and he or she can choose a 
visualization method by shooting a menu box by a virtual 
laser beam emitting from the wand. If you presses another 
button, a virtual tracer particle appears at the tip of the wand, 
when he or she has chosen the particle tracer menu, and 
when the button is released, the particle "flies" under the 
eyes following the velocity field showing the flow structure 
by its trajectory. This kind of user interface of the wand is 
programmable with commercially available basic VR library 
caUed CAVE lib. 

The OpenGL is used to model the virtual world; it is used 
to define the visualization objects and its illumination. A 
BRAVE application program, or more generally, a CAVE ap- 
plication program, is essentially a kind of common computer 
graphics (CG) software without the projection part which is 
automatically processed by the CAVE lib. So, if you are 
familiar with CG programming using OpenGL, it would be 
easy for you to make your own CAVE application. 



Since most of simulation researchers are not familiar with 
CG programming, they feel it difficult to make their own 
visualization softwares for the CAVE. In order to help them, 
we have been developing a general purpose VR visualization 
software named VFIVE for the scientific VR visualization 
in the CAVE. The development of VFIVE started around 
1999 [Kageyama:2000] and the latest stable version is v3.7. 
The present development version with major revise is v3.8. 
The very final version of VFIVE will be v5. 

3.1 VFIVE v3.7 

The basic design and core functions of VFIVE are al- 
most fixed by v3.7, which are summarized in Tabled A 
great emphasis was placed on fully interactive control of 
the visualization methods, data, and the user interface in 
the cave's VR environment. For example, one can con- 
trol the isosurface levels by vertical motion of the hand with 
the wand; it is also possible to change the slice position of 
orthoslicer by the wand's motion. From our experience of 
using the CAVE as a scientific visualization tool from the 
end of 1990's [Kageyama:1999], we see that a common pit- 
fall is to use it just as a (very expensive) "3-D object viewer". 
We should make the best use of CAVE's VR features; that is 
stereo, immersive, and especially interactive view. 

We implemented several kinds of visualization methods 
for vector fields. All of them make the best use the VR 
features of the CAVE. For example, vector arrows shows tens 
of small arrows around your hand, within an invisible sphere 
of diameter of 2 feet. The direction and length of each arrow 
show the vector at the point. As you move your hand, all 
the arrows follow your hand's motion, changing the direction 
and length as the sampled point of each arrow changes in the 
vector field. The interpolation is automatically applied in 
real time. 

3.2 VFIVE v3.8 

Recently, we have improved the VFIVE in two aspects: 
First, we included an important scalar visualization method 
that was missing in the previous version; volume render- 
ing [Drebin:1988]. Another improvement is that we have 
integrated some basic modules of VTK"* into VFIVE. 

The volume rendering is a visualization method of scalar 
fields that is useful, for example, to show the distribution of 
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Table 1. VFIVE v3.7 





function 


Figure 


user interface 


virtual menu panel 


fig El 




virtual laser beam 


fig-Hi 


scalar field vis. 


ortho-slice planes 


fig.m 




local slice plane 


not shown 




isosurface 


figlH 


vector field vis. 


tracer particles 


fig.El 




field (force) lines 


not shown 




vector arrows 


fig.m 




spotlighted particles 


now shown 



plasma density p{x^ y, z) of the 3-D global simulation of the 
magnetosphere. It is known that p is highly localized near 
the Earth. The isosurface is not useful for the visualization 
of this kind of scalar field; you need to try nearly infinite 
number of different isosurface levels to grasp the overall 3- 
D distribution of p. Similarly, the orthoslicer is not useful 
because one need to try a lot of slices to grasp 3-D distribu- 
tion of p. The volume rendering fits best to this kind of 3-D 
scalar field. We have developed a volume rendering module 
of VFIVE and slotted into v3.8. 

Generally, the volume rendering is considered as a 
"heavy" visualization technique for the CAVE-type VR sys- 
tems since it requires millions of ray cast calculation per 
second to realize the real time response to viewer's eyes 
motion in the CAVE room. We succeeded in realizing a 
very fast volume rendering by the 3-D texture-map tech- 
nique [Schroeder:2002]. In this technique, many semi- 
transparent texture mapped slices, which are orthogonal to 
the viewer's line of sight, are pulled out from the a 3-D vol- 
umetric data. The 3-D volumetric data is made in advance 
from the scalar field (such as p) by specifying the colors and 
opacities of each box element (voxel). The texture slices are 
blended by the graphics card. Therefore, we can avoid the 
heavy calculations of software ray casting. This is the rea- 
son why we can carry out the fast volume rendering in the 
CAVE. For example, the refresh rate of the volume render- 
ing shown in Fig. |6l (vorticity distribution of Earth's outer 
core) is several frames per second, which is satisfactory for 
our visualization purpose. 

The VTK (Visualization Tool Kit) is an general visuaUza- 
tion software that includes many visualization methods, from 
basic ones to sophisticated ones, with open source codes. It 
was an attractive idea for us to combine VFIVE's interactive 
visualization environment in the CAVE with VTK's sophis- 
ticated visualization gismos. Recently, we have succeeded 
to integrate some basic visualization methods of VTK into 
VFIVE v3.8. For instance, we can show VTK's iso-contours, 
tubed flow lines (Fig. 0, stream surfaces (Fig. |8ji in the 
BRAVE (see Tabl^. 

4. Summary 

There has been an serious imbalance between the com- 
puter technology and visualization technology. Ultra high 



Table 2. New feaUires in VFIVE v3.8 





function 


Figure 


scalar field vis. 


volume rendering 


fig.i 




isocontours (VTK) 


not shown 


vector field vis. 


stream lines (VTK) 


fig-Q 




stream surfaces (VTK) 


fig.jll 




Fig. 3. Scalar field visualization by isosurface, and orthoslicer. 



■ 




Fig. 4. Vector field visualization by tracer particles. When you press a wand 
button in the CAVE room, a tracer particle appears at the tip of the wand. 
You can intuitively control the starting position of the 3-D vector field by 
the wand motion. 



performance of future computer would become futile exis- 
tence if it were not for the symmetrical performance of the 
data visualization. The advanced visualization should be per- 
formed in a 3-D, interactive, and immersive environment, 
and it can be offered by the virtual reality (VR) technology. 

We speculate that every super computer center in the 
world wiU install die CAVE-type VR facility for the VR vi- 



Fig. 5. Interactive vector field visualization by mrows with tlie isosurface 
rendering. Tlie arrows change the length and direction, following your 
hand's motion in real time with the automatic interpolation of the vector 
field. 



Fig. 7. Stream tube by VTK in VFIVE v3.8. The tube's diameter and color 
changes according to local amplitude of the vector field. 




Fig. 6. Real time volume rendering implemented in VFIVE v3.8 with 
arrows. Compare with isosurface rendering in Fig. |5] The high speed 
volume rendering is realized by the 3-D texture-map technique. 



sualization, and use the software like VFIVE for practical 
and productive visualization routine. 
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Fig. 8. Stream surfaces by VTK in VFIVE v3.8. The color changes 
according to the local ampHtude of the vector field. 
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